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ASPECT RATIO CONVERSION OF VIDEO CONTENT 



FIELD OF THE INVENTION 

[0001] This invention relates in general to the field of video content. More 
particularly, this invention relates to the conversion of video content from a first aspect ratio 
to a second aspect ratio for display. 

BACKGROUND OF THE INVENTION 

[0002] Video content is generally associated with an aspect ratio. This aspect ratio 
is the intended ratio between the width and the height of a display area in which the video 
content will be displayed. Aspect ratios are given in the form widthrheight. For example, 
until recently, televisions have generally had a display area with an aspect ratio of 4:3, that is 
to say, the height of the screen is 75% of the width of the screen. This is known as a "full 
screen" or "standard definition" aspect ratio. Widescreen displays are also available. The 
width of a widescreen television with a display area of a certain height is greater than the 
width of a standard display area for that certain height. Thus, a widescreen aspect ratio will 
be higher than a standard display area aspect ratio. A typical widescreen aspect ratio is 16:9. 
While widescreen displays are becoming more prevalent, much existing content (for 
example, broadcast television) is in a standard aspect ratio of 4:3 or another aspect ratio. 

[0003] A problem occurs when content of one aspect ratio is to be displayed in a 
display area of a different aspect ratio. In order to display content of a certain aspect ratio on 
a display with a higher aspect ratio (e.g., to display content of a standard aspect ratio on a 
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widescreen display), a technique known as pillarboxing is used. In the pillarboxing 
technique, the content is displayed on the widescreen display using the entire height of the 
widescreen display, but not the entire width of the display. Figure 1 is a block diagram of the 
prior art pillarboxing technique for displaying video content of one aspect ratio on a display 
with a second, higher aspect ratio. As shown in Figure 1, the widescreen display 10 contains 
standard aspect ratio display area 20. The height of the standard aspect ratio display area is 
the same as the height of widescreen display 10. However, standard aspect ratio display area 
20 is narrower than the widescreen display 10. The remaining area on widescreen display 10 
are pillarbox areas 30. These areas do not display the standard aspect content. Often these 
pillarbox areas are blacked out or otherwise filled by content which will not distract a viewer 
from the content in the standard aspect display area 20. 

[0004] The result of pillarboxing is shown in Figure 2. Figure 1 is a diagram of the 
prior art pillarboxing technique in use. As shown in Figure 2, pillarboxing areas 30 are the 
blacked out areas on either side of the standard aspect display area 20. The standard aspect 
display area 20 is displaying the standard aspect content. This prior art pillarboxing 
technique has at least two major drawbacks: the first is that a user of a widescreen display 10 
may be disappointed that only the standard aspect ratio display area 20 of widescreen display 
10 is in use. The second is that some displays, for example some plasma displays, may get a 
"burn-in" effect from displaying the pillarboxes 30 for extended times. This burn-in may 
cause a loss in display performance, for example, after extended use of a display using the 
pillarbox technique, a "shadow" of the pillarboxes may be visible to the user when the entire 
widescreen display 10 is being used. 

[0005] Another prior art technique for displaying video content of one aspect ratio 

on a display with a different aspect ratio is to stretch the content uniformly over the display. 

The image is displayed as intended in one dimension (top to bottom) but in the other 

dimension (side to side) the image is uniformly stretched. In order to display an image, given 

an aspect ratio (the original aspect ratio of the video content) and a height (the height of the 

display), an intended width can be calculated. However, because the aspect ratio of the 

display is different than that of the video content, this intended width would not fill the 

display. The prior art technique stretches the video content to a width which will fill the 

entire display. This may be accomplished, for example, using a stretching method in a 

graphics interface which interfaces with graphics hardware. The stretching may also be 

accomplished by using a stretching capability in the graphics processing unit itself. Such 

stretching simply allows for a uniform linear stretch of a rectangular area to fill a greater area. 
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Figure 3 is a diagram of an example of the use of the prior art uniform stretch-to-fit technique 
on the image from Figure 2. In Figure 3, the entire widescreen display 10 is used to display 
an image. This uniform stretch technique may also allow a uniform linear shrink to be used if 
the aspect ratio of the display is smaller than the aspect ratio of the source video content. 

[0006] Thus, uniform stretching can allow the use of the a display of a different 
aspect ratio than the source image. However, since the image was originally intended for 
display on a screen with a lower aspect ratio than the widescreen display 10, the image 
appears distorted. The image may appear "fat" (where the aspect ratio of the display is 
higher than that of the source content) or squeezed (where the aspect ratio of the display is 
lower than that of the source content.) This distortion is one disadvantage of this prior art 
technique. 

[0007] In view of the foregoing, there is a need for a system and method that 
overcomes the drawbacks of the prior art. 

SUMMARY OF THE INVENTION 

[0008] In one embodiment, in order to display a source image of a first aspect ratio 
on a display destination area of a second aspect ratio, the source image is divided into source 
image strips. The destination area is also divided into strips - these are destination image 
strips. There are the same number of source image strips as destination image strips, and 
each source image strip corresponds to a specific destination image strip. Destination image 
strips may be of different thicknesses. A destination strip nearer to a focus area (such as the 
center of the image, in one embodiment) is closer to the aspect ratio of the corresponding 
source image strip. If the second aspect ratio is narrower than the first aspect ratio, a 
destination strip farther from a focus area will be of a narrowed aspect ratio compared to the 
corresponding source image strip. If the second aspect ratio is wider than the first aspect 
ratio, a destination strip farther from a focus area will be of a widened aspect ratio compared 
to the corresponding source image strip. Each source image strip is treated as a texture, and 
texture mapping is used to cover the corresponding destination image strip. 

[0009] In another embodiment, in order to display a source image of a first aspect 

ratio on a display destination area of a second aspect ratio, the source image is divided into 

source image strips. An intermediate destination area of the same aspect ratio is also divided 

into strips - these are intermediate destination image strips. Intermediate destination image 

strips may be of different thicknesses. The source image strips are stretched to fill the 

destination image strips. The intermediate destination area is then stretched uniformly to the 
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second aspect ratio. The sizes of the intermediate destination strip are select so that after this 
uniform stretch, those intermediate destination strips nearer to a focus area (such as the center 
of the image, in one embodiment) are closer to the aspect ratio of the corresponding source 
image strip. If the second aspect ratio is narrower than the first aspect ratio, after the uniform 
stretch, intermediate destination strips farther from a focus area will be of a narrowed aspect 
ratio compared to the corresponding source image strip. If the second aspect ratio is wider 
than the first aspect ratio, intermediate destination strips farther from a focus area will be of a 
widened aspect ratio compared to the corresponding source image strip. 
[0010] Other features of the invention are described below. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] The foregoing summary, as well as the following detailed description of 
preferred embodiments, is better understood when read in conjunction with the appended 
drawings. For the purpose of illustrating the invention, there is shown in the drawings 
example constructions of the invention; however, the invention is not limited to the specific 
methods and instrumentalities disclosed. In the drawings: 

[0012] Figure 1 is a block diagram of the prior art pillarboxing technique for 
displaying video content of one aspect ratio on a display with a second, higher aspect ratio; 

[0013] Figure 2 is a diagram of an example of the use of the prior art pillarboxing 
technique; 

[0014] Figure 3 is a diagram of an example of the use of the prior art uniform 
stretch-to-fit technique on the image from Figure 2; 

[0015] Figure 4 is a block diagram of an example computing environment in which 
aspects of the invention may be implemented; 

[0016] Figure 5 is a diagram of an image divided into vertical strips according to 
one embodiment of the invention; 

[0017] Figure 6 is a diagram of the destination display area divided into destination 
areas according to one embodiment of the invention; 

[0018] Figure 7 is a diagram of the destination display area displaying an according 
to one embodiment of the invention; 

[0019] Figure 8 is a diagram of the source image according to one embodiment of 
the invention; 
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[0020] Figure 9 is a flow diagram of a method displaying a source image of a first 
aspect ratio in a display area of a second aspect ratio, according to one embodiment of the 
invention; 

[0021] Figure 10 is a diagram of an intermediate destination area divided into 
intermediate destination areas according to one embodiment of the invention; 

[0022] Figure 1 1 is an example of an intermediate image according to one 
embodiment of the invention; 

[0023] Figure 12 is an example of a final image according to one embodiment of the 
invention; and 

[0024] Figure 13 is a flow diagram of a method displaying a source image of a first 
aspect ratio in a display area of a second aspect ratio, according to one embodiment of the 
invention. 

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

Overview 

[0025] In order to modify an image of a first aspect ratio to be displayed in a display 
area with a second aspect ratio, the aspect ratio of some of the image content is 
approximately maintained. However, the aspect ratio of other areas of the image content is 
stretched so that the entire resulting image fills the display area. 

[0026] In order to accomplish this differential stretching, texture mapping or 
stretching functions from graphics interface software or on graphics hardware is used. This 
allows real-time conversion of video content for gaming, movies, and other applications. 

Exemplary Computing Environment 

[0027] Figure 4 shows an exemplary computing environment in which aspects of 
the invention may be implemented. The computing system environment 100 is only one 
example of a suitable computing environment and is not intended to suggest any limitation as 
to the scope of use or functionality of the invention. Neither should the computing 
environment 100 be interpreted as having any dependency or requirement relating to any one 
or combination of components illustrated in the exemplary operating environment 100. 

[0028] The invention is operational with numerous other general purpose or special 

purpose computing system environments or configurations. Examples of well known 

computing systems, environments, and/or configurations that may be suitable for use with the 

invention include, but are not limited to, personal computers, server computers, hand-held or 
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laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, 
programmable consumer electronics, network PCs, minicomputers, mainframe computers, 
embedded systems, distributed computing environments that include any of the above 
systems or devices, and the like. 

[0029] The invention may be described in the general context of computer- 
executable instructions, such as program modules, being executed by a computer. Generally, 
program modules include routines, programs, objects, components, data structures, etc. that 
perform particular tasks or implement particular abstract data types. The invention may also 
be practiced in distributed computing environments where tasks are performed by remote 
processing devices that are linked through a communications network or other data 
transmission medium. In a distributed computing environment, program modules and other 
data may be located in both local and remote computer storage media including memory 
storage devices. 

[0030] With reference to Figure 4, an exemplary system for implementing the 
invention includes a general purpose computing device in the form of a computer 110. 
Components of computer 110 may include, but are not limited to, a processing unit 120, a 
system memory 130, and a system bus 121 that couples various system components including 
the system memory to the processing unit 120. The processing unit 120 may represent 
multiple logical processing units such as those supported on a multi-threaded processor. The 
system bus 121 may be any of several types of bus structures including a memory bus or 
memory controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. By way of example, and not limitation, such architectures include Industry 
Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA 
(EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral 
Component Interconnect (PCI) bus (also known as Mezzanine bus). The system bus 121 may 
also be implemented as a point-to-point connection, switching fabric, or the like, among the 
communicating devices. 

[0031] Computer 110 typically includes a variety of computer readable media. 

Computer readable media can be any available media that can be accessed by computer 110 

and includes both volatile and nonvolatile media, removable and non-removable media. By 

way of example, and not limitation, computer readable media may comprise computer 

storage media and communication media. Computer storage media includes both volatile and 

nonvolatile, removable and non-removable media implemented in any method or technology 

for storage of information such as computer readable instructions, data structures, program 
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modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, 
EEPROM, flash memory or other memory technology, CDROM, digital versatile disks 
(DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage 
or other magnetic storage devices, or any other medium which can be used to store the 
desired information and which can accessed by computer 110. Communication media 
typically embodies computer readable instructions, data structures, program modules or other 
data in a modulated data signal such as a carrier wave or other transport mechanism and 
includes any information delivery media. The term "modulated data signal" means a signal 
that has one or more of its characteristics set or changed in such a manner as to encode 
information in the signal. By way of example, and not limitation, communication media 
includes wired media such as a wired network or direct-wired connection, and wireless media 
such as acoustic, RF, infrared and other wireless media. Combinations of any of the above 
should also be included within the scope of computer readable media. 

[0032] The system memory 130 includes computer storage media in the form of 
volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random 
access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic 
routines that help to transfer information between elements within computer 110, such as 
during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or 
program modules that are immediately accessible to and/or presently being operated on by 
processing unit 120. By way of example, and not limitation, Figure 4 illustrates operating 
system 134, application programs 135, other program modules 136, and program data 137. 

[0033] The computer 110 may also include other removable/non-removable, 
volatile/nonvolatile computer storage media. By way of example only, Figure 4 illustrates a 
hard disk drive 140 that reads from or writes to non-removable, nonvolatile magnetic media, 
a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 
152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile 
optical disk 156, such as a CD ROM or other optical media. Other removable/non-removable, 
volatile/nonvolatile computer storage media that can be used in the exemplary operating 
environment include, but are not limited to, magnetic tape cassettes, flash memory cards, 
digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The 
hard disk drive 141 is typically connected to the system bus 121 through a non-removable 
memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 
155 are typically connected to the system bus 121 by a removable memory interface, such as 
interface 150. 
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[0034] The drives and their associated computer storage media discussed above and 
illustrated in Figure 4, provide storage of computer readable instructions, data structures, 
program modules and other data for the computer 1 10. In Figure 4, for example, hard disk 
drive 141 is illustrated as storing operating system 144, application programs 145, other 
program modules 146, and program data 147. Note that these components can either be the 
same as or different from operating system 134, application programs 135, other program 
modules 136, and program data 137. Operating system 144, application programs 145, other 
program modules 146, and program data 147 are given different numbers here to illustrate 
that, at a minimum, they are different copies. A user may enter commands and information 
into the computer 20 through input devices such as a keyboard 1 62 and pointing device 161, 
commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) 
may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and 
other input devices are often connected to the processing unit 120 through a user input 
interface 160 that is coupled to the system bus, but may be connected by other interface and 
bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 
191 or other type of display device is also connected to the system bus 121 via an interface, 
such as a video interface 190. In addition to the monitor, computers may also include other 
peripheral output devices such as speakers 197 and printer 196, which may be connected 
through an output peripheral interface 195. 

[0035] The computer 110 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 180. The remote 
computer 1 80 may be a personal computer, a server, a router, a network PC, a peer device or 
other common network node, and typically includes many or all of the elements described 
above relative to the computer 110, although only a memory storage device 181 has been 
illustrated in Figure 4. The logical connections depicted in Figure 4 include a local area 
network (LAN) 171 and a wide area network (WAN) 173, but may also include other 
networks. Such networking environments are commonplace in offices, enterprise-wide 
computer networks, intranets and the Internet. 

[0036] When used in a LAN networking environment, the computer 1 10 is 

connected to the LAN 171 through a network interface or adapter 170. When used in a WAN 

networking environment, the computer 110 typically includes a modem 172 or other means 

for establishing communications over the WAN 173, such as the Internet. The modem 172, 

which may be internal or external, may be connected to the system bus 121 via the user input 

interface 160, or other appropriate mechanism. In a networked environment, program 
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modules depicted relative to the computer 1 10, or portions thereof, may be stored in the 
remote memory storage device. By way of example, and not limitation, Figure 4 illustrates 
remote application programs 185 as residing on memory device 181. It will be appreciated 
that the network connections shown are exemplary and other means of establishing a 
communications link between the computers may be used. 

Displaying Video Content on a Display with a Different Aspect Ratio 

[0037] In order to provide for the display of video content of a first aspect ratio on a 
display of a higher aspect ratio without the disadvantages of the pillarboxing technique and 
without the extreme distortion of the uniform stretch to fit technique, a non-linear stretch is 
applied to the video content. 

[0038] In one embodiment, an image is divided into vertical strips of approximately 
equal area. Figure 5 is a diagram of an image divided into vertical strips according to one 
embodiment of the invention. In Figure 5, the source image to be displayed at a higher aspect 
ratio has been divided into vertical areas of equal width, source image strip 500. A non-linear 
stretch will be applied to the source image by at least stretching some of these source image 
strips 500. The stretch is a non-linear stretch because at least two of the source image strips 
500 are stretched to different extents. 

[0039] In general, in video content, most of the important detail is in the center of 
the image. The periphery content to the left and right of the center of the source image is 
often extraneous to a viewer's focus when viewing the source image, and it is therefore not as 
important to preserve the aspect ratio in the source image strips 500 which are farther out 
from the center of the image. Thus, in order to apply a non-linear stretch to the image, the 
aspect ratio of the source image will be preserved to a greater extent in the source image 
strips 500 from the center of the source image than in the source image strips 500 located 
more towards the left and right ends of the source image. 

[0040] Figure 6 is a diagram of the destination display area divided into destination 
areas according to one embodiment of the invention. As seen in Figure 6, in order to display 
the image from Figure 5 on the widescreen display 10 of Figure 6, the widescreen display 10 
is divided into vertical strips which are destination areas 600. The number of destination 
areas is equal to the number of source image strips 500 (from Fig. 5) into which the source 
image has been divided. 

[0041] The destination areas 600 which are more towards the center of widescreen 

display 10 preserve the aspect ratio of the source image strips 500 to a greater extent than the 
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destination areas 600 which are located towards the left and right sides of widescreen display 
10. In the example shown in Figure 6, the destination display area (widescreen display 10) 
has a higher aspect ratio than the original source image. Therefore, destination areas 600 
which are located towards the left and right sides of widescreen display 10 are of a higher 
aspect ratio than the source image strips 500. In one embodiment, where the destination 
display area has a higher aspect ratio than the source image, the closer the strips are to the 
sides of the widescreen display 10, the higher their aspect ratio. Figure 7 is a diagram of the 
destination display area displaying the image from Figure 5 on the widescreen display 10 of 
Figure 6. The modified image strips 600 have been placed into the destination areas 500 
from Figure 5. Thus the source image from Figure 5 has been displayed on widescreen 
display 10 with minimized distortion in the center of the image. 

[0042] In order to display a source image on a destination display of a narrower 
aspect ratio than the source image, the same technique can be used. Again, as was shown in 
Figure 5, the source image is divided into an equal number of source image strips 500. 
Figure 8 is a diagram of the source image from Figure 5 displayed in a display area with a 
narrower aspect ratio than the source image. As shown in Figure 8, the narrowed aspect ratio 
display 810 displays modified image strips 800, each destination image strip 800 
corresponding to a source image strip 500 from Figure 5. The strips from among the 
modified image strips which are more towards the center of narrowed aspect ratio display 810 
are closer to the original aspect ratio of the source image strip 500s. The strips from among 
image strip 800 which are more towards the edges of the narrowed aspect ratio display 810 
have a narrower aspect ratio. Thus the source image from Figure 5 has been displayed on 
narrowed aspect ratio display 810 with minimized distortion in the center of the image. 

[0043] Thus, differential stretching of source image strips 500 is used to display 
video content of one aspect ratio on a display of a different aspect ratio. In one embodiment, 
the differential stretching across the strips can be described by a linear equation. In other 
embodiments, other types of equations or other means can be used to determine the 
differential stretching across the strips. 

[0044] In one embodiment, instead of approximately preserving the aspect ratio of 

the source image in the center of the destination image strips, the aspect ratio of the source 

image is preserved in one or more focus areas. Thus, if the primary focus of video content is 

not in the center of the image but to the left of the image, the aspect ratio of the source image 

can be approximately preserved at the left of the image, allowing more distortion at the right. 

Or, if the primary focus of video content is in two or more locations, there may be two or 
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more areas in which the aspect ratio of the source image is approximately preserved, with 
distortion allowed in other areas. 

Use of Texture Mapping to Perform Aspect Ratio Conversion of Video Content 

[0045] In order to provide flexibility in producing graphics, texture mapping is 
provided in many modern graphics hardware elements, and graphics interface software often 
provides methods for using texture mapping. In texture mapping images (textures) can be 
displayed on arbitrary polygonal objects. A texture can be used to cover complex 3D designs, 
without requiring a the computation of a complex polygonal model. 

[0046] In texture mapping, the texture is used essentially as a look up table: 
whenever a pixel in the textured object is to be drawn, a lookup is performed into the texture. 
The value for the texture at the sampled position is projected onto the object, either directly 
or through blending with other pixel value for that pixel. 

[0047] In order to expand or narrow a source image strip 500 to fit in a destination 
area with a different aspect ratio than the source image strip 500, in one embodiment, texture 
mapping is used. The source image strip is treated as the texture, and the destination area as 
the object to which the texture is applied. 

[0048] In one embodiment, each source image strip 500 is converted into a triangle 
mesh. The simplest way to do this is to divide each source image strip 500 is a rectangle, and 
the resultant triangle mesh consists of two triangles for each source image strip 500. It is 
contemplated that more complex display areas may exist which are not rectangles. In this 
case, the strips may not be rectangles but may have more complex top and bottom borders; in 
such cases the triangle mesh may be more complex. Each destination area is similarly 
divided into a triangle mesh. 

[0049] Texture mapping is then used to stretch each source area triangle to fit the 
corresponding destination area triangle. Each of the source image strip 500 triangles is 
treated as a texture, and the texture for a given source image strip 500 triangle is applied to 
the corresponding triangle of the destination area. For example, each triangle of source 
image information may be used as a texture which is then applied to the corresponding 
triangle in the destination areas. Because texture mapping capabilities are generally found in 
GPUs such as GPU 184 (from Figure 4), this allows the processing of the non-linear stretch 
according to the invention to be handled in the GPU 1 84, rather than in a non-dedicated 
processor (such as processing unit 120, from Figure 4). Use of the GPU 184 allows efficient 
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realization of the non-linear stretch, which in turn allows the non-linear stretch to be 
performed, for example, on successive frames of a movie being displayed in real time. 

[0050] Edge correction or filtering may be necessary. In one embodiment, such 
edge correction or filtering is provided automatically by the graphics card, for example, a 
graphics card incorporating a GPU 184 and specialized for 3D graphics. In another 
embodiment, it is provided through graphics interface software which is being used to create 
the graphics. 

[0051] Figure 9 is a flow diagram of a method displaying a source image of a first 
aspect ratio in a display area of a second aspect ratio, according to one embodiment of the 
invention. In step 900, the source image is divided into source image strips. In step 910, a 
destination area is divided into destination image strip areas. These strips are equal in 
number to the source image strips, and each destination image strip corresponds to a source 
image strip. The aspect ratio of the corresponding source image strip is preserved in the 
destination image strip to a greater extent near a focus area, to a lesser extent farther from that 
focus area. In step 920, texture mapping is used to convert the source image strips for display 
in the destination strip areas. 

Use of Stretching to Perform Aspect Ratio Conversion of Video Content 

[0052] While the transfer and stretching of source image strips as shown in Figures 

5-7 may be accomplished as described above, in one embodiment it is performed using an 

intermediate step. In this intermediate step, the source image is changed "in place" - an 

intermediate image of the same aspect ratio is produced from the source image. The 

intermediate image is then uniformly stretched, producing a result which again preserves the 

aspect ratio for content at the center of the image and allows changes in the aspect ratio 

towards the left and right of the image. 

[0053] In such an embodiment, in order to convert an image from a source image 

aspect ratio to a destination area aspect ratio, again the source image is divided into vertical 

strips of equal area, as shown in Figure 5. The first destination of each source image strip 

500, in this embodiment, is a strip of an intermediate destination area which is the same 

aspect ratio as the source image area. Figure 10 is a diagram of an intermediate destination 

area divided into intermediate destination areas according to one embodiment of the 

invention. As seen in Figure 9, the intermediate destination area 1000 is the same aspect 

ratio as the source image. The intermediate destination area is divided into vertical strips 

which are intermediate destination areas 1010. The number of intermediate destination areas 
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1010 is equal to the number of source image strips 500 (from Fig. 5) into which the source 
image has been divided. 

[0054] As shown in Figure 10, where the aspect ratio of the ultimate destination 
area is wider than the aspect ratio of the source image, the intermediate destination areas 
1010 which are more towards the left and right of the intermediate destination area have a 
relatively larger aspect ratio compared to those strips at the center. If the aspect ratio of the 
ultimate destination area were to be narrower than the aspect ratio of the source image (not 
shown), the intermediate destination areas 1010 which are more towards the left and right of 
the intermediate destination area have a relatively narrower aspect ratio compared to those 
strips at the center. 

[0055] As has been described, the intermediate destination image will eventually 
undergo a linear stretch or shrink in order to be the correct aspect ratio of the final 
destination. The aspect ratio of the intermediate destination areas 1010 in the center of the 
image, therefore, are selected in order to provide the minimum distortion after this stretching. 

[0056] Figure 1 1 is an example of an intermediate image according to one 
embodiment of the invention. Figure 1 1 shows the intermediate image after the source image 
information has been transformed to fit the destination areas 1010 (from Fig. 10). Finally, a 
linear stretch is applied to the intermediate image as shown in Fig. 11. Figure 12 is an 
example of a final image according to one embodiment of the invention. The final image is 
in the desired aspect ratio. 

[0057] Thus, again, differential stretching of source image strips 500 is used to 
display video content of one aspect ratio on a display of a different aspect ratio. In one 
embodiment, the differential stretching across the strips can be described by a linear equation. 
In other embodiments, other types of equations or other means can be used to determine the 
differential stretching across the strips. 

[0058] As discussed previously, the linear stretch can be done using a stretching 
method from a graphics API controlling a GPU or in a GPU which performs a linear 
transformation on an image, for example, the Stretch Rect method. 

[0059] Figure 13 is a flow diagram of a method displaying a source image of a first 

aspect ratio in a display area of a second aspect ratio, according to one embodiment of the 

invention. In step 1300, the source image is divided into source image strips. In step 1310, 

an intermediate destination area is divided into intermediate destination strip areas. These 

strips are equal in number to the source image strips, and each intermediate destination image 

strip corresponds to a source image strip. In step 1320, the contents of the source image 
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strips are converted for display in the destination strip areas. In step 1330, a uniform stretch 
is made of the intermediate destination area to the requested second aspect ratio. The sizes of 
the intermediate destination strips are set so that after the uniform stretch, the aspect ratio of 
the corresponding source image strip is preserved in the destination image to a greater extent 
near a focus area, to a lesser extent farther from that focus area. 

[0060] It is noted that the foregoing examples have been provided merely for the 
purpose of explanation and are in no way to be construed as limiting of the present invention. 
While the invention has been described with reference to various embodiments, it is 
understood that the words which have been used herein are words of description and 
illustration, rather than words of limitations. Further, although the invention has been 
described herein with reference to particular means, materials and embodiments, the 
invention is not intended to be limited to the particulars disclosed herein; rather, the invention 
extends to all functionally equivalent structures, methods and uses, such as are within the 
scope of the appended claims. Those skilled in the art, having the benefit of the teachings of 
this specification, may effect numerous modifications thereto and changes may be made 
without departing from the scope and spirit of the invention in its aspects. 
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